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4 BACKGROUND OF THE INVENTION 

3 The present invention relates to the field of digital signal processing, and in particular to the field 

3 

I to adaptive digital filters for beamforming transducer arrays. 

5 15 

Many applications (e.g., radar, sonar, satellite communications, background noise reducing 
hearing aids, etc.) often include a directionally sensitive antenna-array or microphone array 
(generically a beamforming traducer array). These beamforming transducer arrays and their 
associated signal processing are capable of enhancing a desired target source relative to another 
2 0 non-target source (e.g. , a jammer/noise source). The enhancements improve the perceived target- 
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to-jammer power ratio^nR), which, in turn, improves the performance of subsequent, target- 
based processing. 



One application of a beamforrning transducer array is for hearing aids. Hearing aid wearers often 
complain about the corrupting influence of background noise upon their ability to understand a 
desired target source. Enhancing the target relative to the background noise reduces this problem. 
Similarly, applications such as satellite communications, radar and sonar also benefit from the 
directional filtering ability of beamforrning transducer arrays. We shall now discuss the basic 
beamforrning problem. 



2 Beamforrning Background 

2.1 Basic Beamforrning Problem 

The overall beamforrning goal is to extract a desired target signal from within a field of 
non-target, jammer signals using an array of spatially-separated sensors. Specifically, 
beamformers exploit input differences arising from different source directions of arrival 
to create a 'spatial-filter that preserves the target source while nulling the jammer 
sources. Figure 1 shows the basic beamforrning system structure, which filters 
(convolves) each array input x,[n], i = {0, 1, . . . , M - 1} with a corresponding impulse 
response u>,-[n] and sums the resulting signals to form the overall output y[n]: 

M-l 

y[n] = Y, ">«["] * Xi[n]. (2.1) 




Converting E q uX 2.1 into the fluency domain anfntroducing vector notation 
allows for the beamforming operation to be expressed as an inner product: 

Y(u) = W>)A',M = K"(")Zi")< (2 - 2) 

where *,[n] ft *M, ft W »M * 2CM = ^H,-, *,-i(«)] T . 

EM = W - d " is the hermitian ( co ^ lex - conjusate trans - 

pose) operation.' The main issue involved in the design of a beamforming system 
is the selection of the array weights I£M that yield the desired spatial-filtering be- 
havior As described in Section 2.3, these weights may be cither time-invariant or 
time-varving. Time-invariant weights typically achieve simple and robust processmg, 
while time-varying weights are often capable of superior performance. 

2.2 Beamforming Terminology 

Before discussing the beamforming weight-selection process, this section introduces 
the basic terminology that is used to discuss beamforming systems. 

2.2.1 Coordinate System 

Beamforming systems use spatially-separated sensors to extract a target source from 
within a field of jammer sources. The spatial dimension of this task requires a coor- 
dinate system to describe both array element and source locations. 

Figure 2 shows the three-dimensional, polar-coordinate triple, (p Q) 0 Q ,4> o ), that 
corresponds to the cartesian coordinate triple (x 0 , y 0 , -o)- In this representation, (1) p 0 
is the distance from (x 0 ,y 0 ,*>) to the origin, (2) 9 0 € [-f , f ] is the angle between 
(x 0 , y 0 , =o) and the yz-plane (positive if x 0 > 0 and negative if x 0 < 0), and (3) (j> 0 € 
[--,-] is the angle between the projection (0,y 0 ,*o) of (x 0 ,y 0 ,-o) into the yz-plane 
and the positive z-axis. The triples (x 0 ,y 0 ,-o) and {p 0 J 0l <f>o) are related as follows: 



Po = \/xl + yl + zl 

0 Q = tan" 1 —7%=T (2-3) 
<f> 0 = tan" 1 f n 



5 This polar coordinate definition is slightly different from traditional polar-coordinate 

definitions, but it simplifies the analysis of broadside arrays (Section 2.2.2), which are 
used for much of this research. 

In the analysis of beamformer behavior, it is assumed that all sources are far-field 
and produce plane waves that propagate across the array, i.e., p = oo, which means 
10 that (0, <f>) alone specifies source locations. The theoretical target source location is 

assumed to be known and fixed along the positive z-axis: (6 t ,4>t) - (0,0). 

2.2.2 Array Configurations 
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The array elements lie at known, fixed locations within the array environment and 
may be arranged in any desired configuration. One special type of array is a uniform 
linear array (ULA), in which the array elements are co-linear and equally-spaced by 
a distance d. Figure 3 shows two ULA examples, which are defined relative to a 
specified target location (along the positive z-axis). For these two configurations, 
endfire and broadside, the array elements are respectively oriented coaxial with and 
perpendicular to the target propagation direction. 

The simple and regular structure of ULAs allows for straightforward system anal- - 
ysis, and, for this reason, the specific systems that are designed and simulated in the 
following chapters will have broadside ULA configurations. The coordinate system of 
Section 2.2.1 is convenient for the broadside ULAs of Figure 3b, because only the 
9 location parameter is needed to describe the impact of a specific source upon the 
free-field array (due to the cylindrically-symmetric behavior about the array axis). 
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2.2.3 Source^^ Array Transfer Function((t(a;, ^> 0) 
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The array element locations, the source locations, and the knowledge of the source 
propagation rules within the array environment allow for the definition of a source- 
to-array transfer function that relates each source to each array element. Consider a 
source, 5(w, 0, located at (9, <j>). This source produces a signal # t (w, 9, $)S(u, 9, <j>) 
at array element i, where H { (u),0,cf>) is the source-to-element transfer function. The 
overall array input due to S(ui, 9, <f>) is thus 





A'o(w) 




H 0 (u,9,<p) 




Xx{u) 








m A'a/-i(w) _ 







(2.4) 



where H_(uj, 0, (f>) is the source-to-array transfer function vector. Because beamform- 
ing exploits the relative differences between the input signals, the source- to- array 
transfer functions are usually normalized by i£o(w,0,<£). Defining ff,(w,0,^) = 
Hi(u,9,<p)/H 0 (uj,9, <f>), the normalized source-to-array transfer function vector is 



1 

H M -i(u,0,4>) 



(2.5) 



15 Under the assumption of far-field sources that propagate as lossless plane-waves 
across the array and that the array is operating in the free-field^ it is possible to 
determine #(u;, 9, <f>) explicitly. In this case, the individual-element transfer functions 



6 



10 



ft 

e dela 



H{(u,\ t 0, <p) are pure delays, since the amplitude does not decay, 

The delay r,(0,0) is equal to the additional distance, di(9, <f>), that the propagating 
wave travels between elements 0 and z, divided by the propagation velocity c: 



The array geometry provides a means for determining the di(9,<f>) for a given source 
location. Note that, since element 0 is used as the reference, d 0 (u>, 9, (j>) = 0, which 
yields H 0 (uj, 9, <}>) = 1 as desired in Equation 2.5. 

For a free-field ULA, each <f,(0, <}>) may be stated in terms of di(9, <f>). Specifically, 
the equal inter-element spacing and the linear array orientation result in 

di(u;,9,<f>) - di-xiu^,*) = i = {1,2,...,M- 1}. 

This reveals that d { (9,<f>) = idi(9,<t>), and, since r,(0,0) = this yields 
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Hx(u,e,cf>) 


H{u, 9, 6) = 










Hx{u;,9,<i>]* 




... (M-n«i,(e,«) 

& c 




e MM-\)n(e,<t>) 




^(u,9,<f>)^ 



(2.6) 



15 Based on the coordinate system in Figure 2 and the ULA examples in Figure 3 
the following di(0,<})) values can be determined, 



Endfire: di(0, <f>) = d cos0 cos<f>, 
Broadside: d { (0, <f>) = d sin0, 



(2.7) 



where d is the inter-element spacing. 
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2.2.4 Overall Amt Signal 



The source-to-array transfer functions allow for the expression of the overall array 
input as the superposition of the individual-source array inputs. For example, given 
L sources 5(u;, 0,, <£,),/ = {1,2,...,/;}, and the corresponding source-to-array transfer 
functions #(u;, <?/), the array input is 

X(u) = £ S(lj, 9 h tfiEfc, Ou <M- (2.S) 

Since the following beamforming techniques are narrowband and operate only on a 
narrow band of frequencies, the following discussions suppress the explicit u depen- 
dence. 



2.3 Beamforming Methods 

In order to see how H£ determines a beamformer's spatial filter characteristic, combine 
Equations 2.2 and 2.8 



Y = W H X = W H 



L 

L/=i 



Ui G($ tt <t>i) 



This output expression reveals that each source S(9i,4>\) in the array input is also 
present in the array output, but it is scaled by the location-dependent factor known as 
the directional array response G(9, <j>) = W H R(9, This scaling factor demonstrates 
the effect of H£ upon a source from the (9, <f>) direction. 

The overall spatial-filtering, beamforming goal is to determine a W such that 
G(9, 4>) = 1 for the target source and G(9, <f>) = 0 for the non-target, jammer sources. 
In the special case where the target and jammer source-to-array transfer functions 
are known [i.e., the target is at (9t,4>t) and the jammers are at known locations 
{9j.ki<!>j,k)'> k = {1,2, ...,yV/ — 1}]. it is possible to formulate a system of linear 



equations whose^^ution achieves this goal: 
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G(9t,4>t) 
G{9j %u 4>j a ) 



K H {Qt, <Pt) 





1 




0 


w = 




m 0 



(2.10) 



where the equality G(0, <j>) = W H H(0, <f>) = H(0, <j>) H W_ has been used 

Equation 2.10 cannot be used for general beamforming purposes, since the jam- 
mer locations are unknown and, usually, time-varying. Other methods have been 
developed to generate beamforming weight vectors that meet the desired goal. These 
techniques fall into two categories: 

!• Time-Invariant Systems: in which W is fixed and optimizes a general perfor- 
mance criterion, such as the array directivity index. 

2- Time- Varying Systems: in which W is continually updated to suit the particular 
beamforming environment 

Time- invariant systems have the advantages of simple implementation and robust op- 
eration, but the unchanging nature of these systems requires that the beamforming 
be optimized to yield generally-good performance in all potential array environments. 
This requirement prevents these beamformers from achieving the maximum possi- 
ble level of jammer cancellation that is attainable for the particular environment in 
which the system is operating. Time-varying systems, on the other hand, have the 
advantage of continuously updating the beamforming in order to achieve the optimal 
performance for the particular array environment. This improved performance arises 
at the cost of more computationally-demanding processing, and these systems may 
cancel the target under certain conditions. 
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Since LENS Mjcessing is time-varying, this resear^J^nsiders only time-varying 
systems. The foirWing discussion introduces these systems in three parts. First it 
presents the simplest concept of optimal beamforming for a given environment and 
introduces the robustness problems that arise with this system. It continues with 
a discussion of the traditional, robustness-enhancing modifications to the original, 
non-robust weight-vector definition. It concludes with a description of some imple- 
mentations that may be used to approximate these systems. 

2.3.1 Traditional, Non-Robust Beamforming 

Equation 2.11 describes the traditional, non-robust frequency-domain beamforming 
weight-vector, which is chosen to minimize the expected output power at each fre- 
quency, £[|K| 2 ]> subject to the constraint of preserving unit gain for the known target- 
source location: 



&R = argmin E[\Y\ 2 ] = argmin E[W H XX H W) = argmin W H R KX W 

subject to (2-11) 

where R xx = E[XX H ] is the input covariance matrix and Kt^tt = Kih, <fo) is the 
target-to-array transfer function vector. Solving this problem via Lagrange multipliers 
yields the solution: 

iknr = rf^f-r ■ (2.i2) 

ii-target "A" A' n target 

In beamforming literature, this weight vector is referred to by several different names, 
including the Maximum Likelihood Method (MLM) weight vector and the Minumum- 
Variance, Distortionless Response (MVDR) weight vector. This research uses a third 
appelation, NR, which reflects that this is the baseline, non-robust situation of the 
Constrained, Minimum- Variance (CMV) weight vector [described in Section 2.3.2]. 
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This defmitioj*rf the optimal beamforming weight ^^or seems logical - by mini- 
mizing the expec^i output power while preserving the target signal, the weight vector 
must be attenuating the jammer sources in the environment. This system works well 
under ideal conditions, but, unfortunately, problems arise under more realistic con- 
ditions. These problems result from discrepancies between the assumed and actual 
target-to-array transfer function vectors: ^ arget and danger 

The primary effect of the discrepancies between Ki^ set and iLarget is that they 
can result in cancellation of the target signal - an obviously undesirable effect in any 
beamforming system. To see how this behavior arises, consider the case when only 
the target is active within the array environment. If /£t arget and itarget are different, 
then it is possible for the beamformer to find ]£ NR such that 



^target^NR = 
* H 

O target J^NR = °' 

JJj In otlier words, the beamformer can completely eliminate the actual target signal 

ll while st iH preserving the assumed target-to-array transfer function. 

^ 5 Generalizing this result to situations in which both target and jammer sources 

»_ are present, the following behavior is observed. When the target is weak relative to 

==□ tne jammers, i.e., the TJR (target-to-jammer power ratio) is low, then the jammer 

V power dominates the beamforming, and the system cancels the jammer signals. When 

jjjj the target is strong relative to the jammers, i.e., the TJR is high, then the target 

20 dominates the beamforming and the target cancellation described above may happen. 

The most obvious means of avoiding target cancellation would be to obtain a better 
target-to-array transfer function estimate [i.e., to reduce the discrepancies between 
target and 27t ar(Eet ] for use in Equation 2.11. Unfortunately, this is not an easy task, 
given the following causes of discrepancies between Ktac&t and iLargw: 

25 L Array Mis- Alignment /Mis-Steer: in which the target is not located exactly at 

its assumed location, e.g., it might be near-field or slightly off center. 

2 - Element Placement F.rrnrs- in which the array elements are not located at ex- 



11 



actly the ^pified array locations. 

3 - Element Gain Mismatch: in which the array elements have unequal gains. 

4 - Non-Free-Field Array Operation: in which objects that are located near the 
array scatter the incoming wave-fronts, e.g., a hearing-aid array mounted on 
the head. 

5 - Multipath-Propagation/Reverberation: in which the target signal arrives from 
both the actual target location and non-target locations (wall reflections). 

These effects are difficult to estimate and usually change over time, which renders 
it impossible to maintain a highly accurate estimate of ^ arget in practice. For this 
reason, modifications have been made to the definition of the optimal beamforming 
weight vector of Equation 2.11 in order to increase its overall robustness to target- 
cancellation. The following section describes one class of modifications. 

2.3.2 Robust Processing: CMV Beamforming 

Constrained, Minimum- Variance (CxMV) beamforming is a classic approach to in- 
creasing beamforming robustness. It operates by imposing additional weight-vector 
constraints to the traditional, non-robust optimization of Equation 2.11: 

li-CMV = argmin W H R X xK (2.13) 

W_£C M 

subject to: 

C H W = g and W H W < S~ 2 , 

where (C,g) describes a set of linear constraints (that must include preservation 
of the assumed target-to-array transfer function, tf£ rget I£ = 1) upon the weight 
vector and 5~ 2 is a quadratic constraint on the weight vector norm. Note that CMV 
beamforming reduces to traditional, non-robust beamforming [Equation 2.3.1] when 
C = bargee, £ = 1, and 5~ 2 = oo. Additionally, when 5~ 2 = oo, then no quadratic 
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constraint is imaged upon the weight vector and (M beamforming reduces to 
linearly-constrai^W, minimum-variance (LCMV) beamtorming. 
The solution to Equation 2.13 may be written as: 

i^CMV = (Rxx + €l)- l C[C H (R xx + eI)- l C]- l g. (2.14) 

When there is no quadratic constraint, i.e., when S~ 2 = co such as for traditional, 
non-robust and LCMV beamforming as described above, this solution is closed-form 
with e = 0. When the quadratic constraint is active, however, this solution is not 
closed-form and e must be adjusted iteratively until W H W < S~ 2 . 

The constraints C H W = g an d W H W < 5~ 2 discourage target cancellation in 
the following manner. The linear constraint C H W =. £ imposes restrictions on the 
behavior of the directional array gain G(9, <f>). For example, the required constraint of 
££r 6 etl£ = 1 ensures that the assumed target gain is unity: G{9 T , <h) = 1. Derivative 
constraints may be added to force G{9, 4>) to have a flat derivative about the 
assumed target location, which prevents the system from canceling targets that are 
close to the assumed target location. Alternatively, eigenvector constraints that keep 
G{0, <f>) 'near' a desired behavior about the assumed target location may be used. ' In 
general, the linear constraints are designed to increase system robustness to highly 
structured deviations (e.g., array misalignment) between the actual and assumed target- 
to-array transfer function. 

The norm constraint, W M K < 6~ 2 , imposes restrictions on the white-noise-gain 
of the systpm. Specifically, the white noise gain, G w measures the 

improvement in the output relative to the input TJR (target-to-jammer power ratio) 
when no directional jammers are present and only uncorrected noise is introduced 
at each array element: 

r _ \iL% et W\ 2 1 

where the fact that ££ rget W = 1 has been used. By maintaining W H W < 8~ 2 , 
then G w > 5 2 , which guarantees a minimum level of beamforming improvement, even 
in the presence of uncorrelated sensor noise. This norm constraint incroases system 
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robustness to fad^ such as array-element placement^^pr, which are independent 
and may be regamed as additive uncorrected noise at the array input. 



2.3.3 Traditional Implementations 

In general, the array environment and input covariance matrix are unknown and 
time-varying, which prevents direct solution for the optimal CMV weight vector as 
described in Equation 2.13. Approaches have been designed, however, that approx- 
imate the optimal solution and that track the changing array environment. This 
section introduces three such implementations. The first two implementations are 
possible only when S~ 2 = oo, such as for traditional non-robust and LCMV beam- 
forming sub-classes of CMV beamforming described above. The third technique is 
more general and may be used with any CMV formulation. 

All implementations use a temporal stream of array-input observations, {-V (,) }, to 
derive a corresponding temporal stream of beamforming weight vectors, {W^mv}' 
For the broadband processing simulated in much of this research, the narrowband 
X} 1) arise through block FFT processing on the broadband input. 



Direct Matrix Inversion: In the absence of a weight vector norm constraint, i.e., 
when 5~ 2 = oo, the solution of Equation 2.14 is closed form. In this case, W^)^ y 
may be obtained by forming an input-covariance estimate R?£ x 

and using this estimate in Equation 2.14. This method is known as the 
Direct Matrix Inversion or DMI method, because it involves the inversion of the esti- 
mated covariance matrix. The main advantage of this implementation is its relatively 
fast adaptation time to a changing array environment: adaptation time is governed 
entirely by the delays associated with the covariance matrix estimation process and 
are independent of the array environment. Unfortunately, this fast adaptation comes 
at the cost of matrix inversions, which can be computationally expensive [0(M 3 ) 
operations]. 
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Frost Processii^i An aiternatii^iplementation to the DMI 

implementation,^^ for the special case when 6~ 2 = 00, is a Least-Mean- 

Squared (LMS) based adaptive approach that uses a gradient search to converge upon 
the optimal beamforming weight vector. Specifically, the weight vector follows the 
5 gradient towards minimal output power, but it is projected back into the constraint 

subspace (defined by C H W = g) at each iteration: 

l^CMV = K c + P c [l-^X} l)H \\^ iV , (2.16) 
where 

m* = C{C H C)- x g and P C = I-C(C H C)- X C H . 

This processing has the advantage of being less complex [0{M 2 ) operations] to imple- 
ment than DMI, but this complexity advantage comes at the cost of longer adaptation 
10 times: adaptation time is proportional to where A min is the smallest eigenvalue of 

the underlying input R xx , which means that certain array environments can exhibit 
very long adaptation times. Details of this technique are set forth in the paper 
entitled "An Algorithm for Linearly Constrained Adaptive Array Processing", Proc. 
IEEE, 60:926-935, August, 1972, O.L. Frost. 

15 Scaled Projection Algorithm: The processing set forth above may be altered yield 
an adaptive beamformer implementation that includes the weight vector norm con- 
straint, W H W < 6~ 2 . In this case, the basic Frost algorithm is used, but the weight 
vector is restricted to obey W_ M W_ < 5~ 2 at each step: 



Step 1: £ (,+1) = p c []/«) _ f,X^X^ H W^ MW ] 
Step 2: V< ,+1 > = l 



r[l+l 



Step 3: W^l^Wt + Vj+t (2.17) 

where: = C(C H C)~ l g, P c = I — C(C fI C)~ l C, 
and b 2 =S~ 2 -g H (C H C)- l g. 
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As with Frost pr^^ing, this processing has the advan^^ of being relatively simple 
to implement [0{M 2 ) operations] but it may exhibit long adaptation times. 



As set forth above, a significant about of care (i.e., constraints) must be taken when 
5 defining the optimal beamforming weight vector in order to yield a solution that is 

robust to situations that may cause target cancellation. The CMV definition provides 
one possible solution to this problem, but it suffers from some disadvantages. 

1 . The CMV constraints are indirect - their impact upon the beamforming 
performance and their prevention of target-cancellation can be difficult to 

10 understand. This renders the overall constraint-selection process 

confusing. 

2. Each linear CMV constraint in (C,g) reduces the beamformer degrees 
of freedom by one. Under good beamforming conditions, e.g., when the 
TJR is low, this reduction in the degrees of freedom limits the potential 

15 jammer cancellation. 

Therefore, there is a need for a robustness-control mechanism, which yields a system 
. that has direct and flexible control over the beamforming process. 
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i INVENTION 



SUMMARY OF THE 

Briefly, according to the present invention, an adaptive multi-tap frequency domain digital 
filter processes an input signal vector X from a plurality of spatially separated transducers that 
detect energy from a plurality of sources including a target energy source and at least one non- 
5 target energy source. The filter receives and processes the input signal vector X to attenuate noise 
from non-target sources and provides an output signal vector Y. Tap weights W N for filter are 
selected by first parameterizing each of the tap weights W N such that each of the tap weights W N 
is characterized by a vector of parameters /}^ , and the solving for each parameter of the vector 

P 0 p,ty minimizing the expected power of the array output signal Y. A robustness-control 

10 transformation is then applied to the vector p^to provide a robust vector )3 b , wherein the 

robustness-control transformation identifies and reduces target canceling components of the vector 
3 ^ op , while Preserving non-target canceling components. Finally, the weight vector indicative of 

] the filter tap weights is formed as a function of the vector J3 . 

\ S—roh 

'* The tap weight selection technique of the present invention preferably executes in real- 

1 1 5 time. The technique may be used with transducer arrays such as microphones (e.g. , hearing aides, 
j sonar processing, etc. . . .) and radar receivers where it is desirable to attenuate signal contributions 
* associated with non-target signal sources. 

= Beam forming parameterization identifies parameters of the vector that describe the 

nulling behavior of the tap weights W w . 
2 0 The present invention uses a direct and flexible robustness control mechanism to yield a 

beamformer that provides good performance and it robust to a wide variety of adverse conditions. 

Notably, the present invention includes a novel robustness-control mechanism, which 

parameterizes the beamforrning problem and yields a system that has direct and more flexible 

control over the beamforrning process. 
25 Advantageously, selecting the tap weight of the adaptive filter according to the present 

invention nulls (i.e., attenuates) signal components associated with non-target noise sources, while 
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retaining signal componRus associated with a desired target source(s). 

These and other objects, features and advantages of the present invention will become more 
apparent in light of the following detailed description of preferred embodiments thereof, as 
illustrated in the accompanying drawings. 



18 



BRIEF DESCRIPTIOfTOF THE DRAWINGS 

Figure 1 is a block diagram illustration of a beamforming array; 
Figure 2 is a plot of a coordinate system; 

Figure 3A and 3B (collectively Figure 3) are simplified pictorial illustrations of two 
uniform linear array (ULA) configurations with respect to a target; 

Figure 4 is a block diagram interpretation of the processing according to the present 
invention for a four element ULA; 

Figure 5 is a plot of the transformation of p to P rob , ; 

Figure 6 is a pictorial illustration of the distance metric Q between the vector Z and the 
subspace S; 

Figure 7 is a plot of the contours of various values of Q, (/?) for ULA arrays having 2,3, 
4 and 5 elements; 

Figure 8 is a plot that illustrates three LENS parameter classification regions for an array 
having three elements as described by Equation 3.20 with Q r =30° and Q r = 60°; 

Figure 9 is a plot of the contours for a three element array and Q(# ) =30°, 40°, 50° and 
60° with p t indicated as (x); 

Figure 10 is a plot that illustrates three LENS parameter classification regions for a three 
element array according to Equation 3.23 when R T and Rj are chosen to reflect the R T =30° and 
Rj =60° contours, respectively; 

Figure 1 1 is a plot of illustrating four examples of p oplJ for a two-element array along with 
the corresponding LENS robustness regions; 

Figure 12 is a flow chart illustration of processing steps according to the present invention; 

Figure 13 is a flow chart illustration of alternative embodiment processing steps according 
to the present invention; 

Figure 14 is a flow chart illustration of yet another series of alternative embodiment 
processing steps according to the present invention; 
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Figure 15 is a biRk diagram illustration of processing steps for solving for J3 given a 
known covariance matrix; 

Figures 16A and 16b (collectively Figure 16) are block diagram illustrations of processing 
steps regarding the adaptive relaxation based solutions; and 

Figure 17 is a plot that illustrates the relative computational complexity for the complete 
update relaxation, partial update relaxation and gradient LENS implementations. 
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DETAILED DESCRIPTION OF THE INVENTION 



3 LENS Beamforming Processing 

The present invention is directed to a beamforming technique that modifies traditional non-robust 
beamforming to increase beamforming robustness by preventing target cancellation. Significantly, 
unlike the prior art, the present invention solves for the robust weight vector indirectly by dividing 
the beamforming process into three components/steps. 

Like CMV beamforming [Section 2.3.2], Location-Estimating, Null-Steering (LENS) 
beamforming modifies traditional, non-robust beamforming [Section 2.3.1] in an at- 
tempt to increase beamforming robustness by preventing target cancellation. LENS 
differs from CMV processing however, in that it does not solve for a robust beamform- 
ing weight vector directly. Instead, it solves for the robust weight vector indirectly 
by dividing the beamforming process into three components: 

1. Estimation of the optimal LENS parameter set, ^ pt , that describes the tradi- 
tional, non-robust beamforming problem. 

2. Transformation of into a 'robust' parameter set, /J^, that is designed to 
ensure robust beamforming and to prevent target cancellation. 

3. Use of ff^ ob to generate a final beamforming weight vector. 

It should be noted that LENS processing assumes that target = [1,1,---, 1] T = L 
This target-to-array transfer functions arises naturally for broadside ULAs [Sec- 
tion 2.2.2]. For more general arrays, it may be realized by scaling each array input i 
by the steering factor ^ 1 ^ , , where {iitargejt is the i th element of ff targct . 

The primary advantage of the LENS parameterization is that it allows for the use 
of an innovative and direct method of beamforming control. Consider as an example 
Uniform Linear Arrays (ULAs), for which each parameter fi opt ^ in determines a 
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beamforming nul^^ation in the array environment [SSBn 3.3.1]. In the process 
of transforming into ^ o6 , it is possible to control where the final beamforming 
weight vector will place its nulls [Section 3.3.2] and to prevent target cancellation 
by restricting these nulls to be a certain angular distance away from the assumed 
target location. (It is this manifestation of the algorithm that leads to the Location- 
Estimating, Null-Steering appellation.) 

This chapter develops the basic components of LENS beamforming. It begins 
by introducing the the LENS weight vector and parameter set. It then determines 
the optimum LENS parameter set to describe traditional, non-robust beamforming 
and defines the LENS robustness transformation. It concludes by drawing these 
components together into the overall, general LENS algorithm. 



3.1 The LENS Beamforming 
Weight Vector 

The key component of LENS processing is the LENS beamforming weight vector. 
I£leNS,a/(£)- For an ^/-element array, this weight vector is determined from the 
M - 1 LENS parameters, /? = [/?i,/?2, • • • ,0M-i], as follows: 

[(i-ift) (i+ift) ]*•••*[ (i-j/fa-i) (i+iflu-i) J> 

where the V operation denotes row vector convolution, It turns out that the LENS 
parameters /? provide a convenient description of the beamforming that is realized by 
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1¥-LENSm((D and^^isequently, they may be used to c^^bl the beamforming and 
to prevent target cancellation. 

In order to understand how I£lENS,a/(/E) arises and to obtain a 'first look' at the 
relationship between 0 and IElEi\S..v(£), consider the two-element I£lENS.2(A): 



J£lens, 2 (/?i)"=[^ iiifit] 



(3.2) 



Defining xb such that 



0i+ j 



0i= j 



0 + 1 



01-j "'"^-l' 

where both 0 and fa may be complex, and substituting into I£lenS,2(/?i) yields 

I£ L ENS, = [ ^ j.], 
where ]£ LE NS. 2 (A ) ""target = 1 and IZleNS^A)*^ = 0, with 



(3.3) 



H,, = 



1 

0 



The one-to-one relationship between 3 X and 0 shows that /? x completely describes the 
nulling behavior of HlLENS.AfC^)- 

The precise nulling behavior depends upon the actual source-to-array transfer 
functions ff{9, <f>) for the array in question. Consider the special case of far-field 
sources, for which the source-to-array transfer functions are given by Equation 2.6: 



tf(0, 4>) = 



1 



By equating 0 = e*"W*> and substituting into Equation 3.3, then ]£ L ENS„v(£) 
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clearly nulls soi^^locations (0, <j>) that satisfy: 

^ l 3 e jwT(6,<t>) _ J ~ J^ wrjg.d) j ~T(6M — C °t I I . (3.4) 

In this special case, since r(0,<£) is real, ft is also real. As discussed in Section 3.3.L 
for general :W-element ULA architectures with far-field sources, each LENS parame- 
ter /?, determines one beamforming null location through a similar relation to Equa- 
tion 3.4. For more general non-ULA array architectures and for near-field sources, 
the relationship is more complex. 

The iterated-convolution, M-element LENS weight vector, J$1lenS,a/(/?)> may be 
interpreted as a cascade of the two-element LENS weight vectors [Equation 3.2]. 
Figure 4 shows this cascade for the special case of a ULA array architecture with 
far-field sources, for which each LENS parameter and; consequently, each stage in the 
cascade produces one null in the array directional response [Section 3.3.1]. 



3.1.1 LENS Weight Vector: a Re-Formulation 

The LENS beamforming weight vector I£lENS,a/(£) may be re-expressed in a man- 
ner that simplifies the analysis of the LENS algorithm. It can be shown that 
i^LENS.A/(£) is equal to the linear transformation T M of another vector £/lENS.a/(£) : 

Klens,m(0) h = £lens,a/(£)"7m, (3.5) 

where #LENS,A/(£) is defined as 

^LENS,A/(£)" = J [1 0i 1 * [ 1 02 ]*■••*[ 1 0M.il (3.6) 
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and T\j is given 



rpH _ 

1 m — 



[11] * [11] * • 
[11] * [11] * •• 



[1 1] * [1 1] 
[11] * f ~j j J 



[11] * [_ ; j] * ... * {_j j) * [_j j] 
[ -J j] * [ -j j] * ••• * [ —j j] * [ -j j ] 



k — 1 pairs per row 



3.2 Optimal Beamforming Re-Expressed as LENS 

The LENS weight vector allows for the LENS parameterization of traditional, non- 
robust beamforming [Section 2.3.1]. Specifically, define 0^ to minimize the expected 
power in the LENS array output signal Y = J£ LENS M (/3) H 2L: 

^ pt = Em ®^ = *^™_ n , ^LENS.A/(£)" RxxW LEm , M (P). (3.S) 

Tllis (L P t y' ields a I^LENS.w^) that is equal to the traditional, non-robust ]£ NR 
from Equation 2.11. To see why this is so, consider the following proof. 



Given that ^ satisfies Equation 3.8, then WxENS.A/(£, pt ) = I£nR, where 
W NR satisfies Equation 2.11 in the case where steering delays have been applied 
to the array so that /£t arget = I: 



i^NR = argmin W H R XX W_ (3.9) 
w <= c M - 

subject to: l H W = 1. 
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Define the set A of M-dimensional beamforming weight vectors that are rep- 
resented by I£leN'S,a/(£) as spans the space of M - 1-dimensional complex 
vectors, C A/_1 : 

^ = {I£lens,m(^)€C w |^€C a ^}. 

It can be shown that A is equivalent to the set B of all M-dimensional 
complex vectors ]V that sum to 1: 

B = {]£€ C A/ |l"]£ = 1}, 

where 1 = [1, 1, ... , l] r . Hence A = B. 
Using the set B, Equation 3.9 may be re-written as: 

I£NR= argmin W H R XX W, 

where W clearly varies over the entire set B for the optimization. Repeating 
Equation 3.S, the optimal LENS parameter set is: 

(1 = argmin KleNSmH)" R xxKlENS,m(. 3 )^ 

where 1ElENS..vC#) varies over the entire set A for the optimization. 
15 Since (1) W varies over B, (2) KlenS,m((D over A, and (3) A = B, then 

&ENS,A/(£, pt ) = 1£nr- 
3.2.1 Closed-Form LENS Solution 

The equality of ]£lens,a/(£) and ]il NR) as described above, and the LENS re- 
20 formulation from Section 3.1.1 may be combined to yield a closed-form expression 
for iopf Specifically, using the closed-form solution for [Equation 2.12] and 
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recalling that SJ^m = L then 



Now, recall that I£ L ENS,u = ILlenSm((LJ Ht 5' (Equation 3.5] and 

it is known that Q\ t = exists, which leads to 



1 ti-xxi- 



Finally, use the fact that the elements of the vector LLlenSm((D H form the coefficients 
of a polynomial that has roots at [Appendix B] to obtain the expression for 0 



l pt = -roots (UushsM&J") = -«»t8 ( ^i^ff ) • (310) 

Equation 3.10 reveals that 0^ may be obtained by inverting Rxx and performing 
a polynomial root solution on the polynomial described by #leNSa/(£)- 



3.3 Transforming §^ pt into /3 rob 

As shown above, 0^ is a parameterization of the traditional, non-robust beam- 
forming of Section 2.3.1. This means that a beamformer that uses IElENS A/(^ pt ) 
would exhibit all of the non-robust, target-canceling characteristics of the original, 
non-robust approach. The key feature that differentiates LENS beamforming from 
traditional, non-robust beamforming is the robustness-control transformation of 0 
int0 £ro6* ^his transformation uses the relationship between 0 and the nulling be- 
havior of HELENS , m (§) to identify and eliminate any target-canceling components of 
0^ while preserving the jammer-canceling components. 

The robustness transformation is achieved by classifying each optimal LENS pa- 
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of three sets and then transforming^ 



rameter (3 opUi into^P of three sets and then transforming^ according to the rule: 



0rob,i = < 



0 (3 opt ,i 6 T 



where T and J are the 'target-canceling' and 'jammer-canceling' LENS-parameter 
regions, respectively. Figure 5 demonstrates this process graphically for param- 

5 eters in each of the three classes. For (3 opt<1 € T, the LENS parameter contains 

primarily target-canceling information, and so f3 ro b,i is set to 0, which is a 'safe 
non-target-canceling parameter value. For j3 opt , 2 € J, the LENS parameter contains 
primarily jammer-canceling information, and so (3 rob ,i is set to the unaltered /? opt ,,\ 
For 0 opt ,3 € TU J, the LENS parameter is in an intermediate region and 0 ro b,i is 

10 set to F[/? opt ,,], which is a smooth transition between the 0 opt ,i € T and 0 opt ,i € J 
extremes. 
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Equation 3.1^^eals that the main element in the^jf 0^ transformation is 
the parameter classification T, J, and TUJ. The following discussion develops this 
classification in two stages. The first stage explores LENS parameters and investi- 
gates the beamforming information contained in 0, while the second stage uses this 
information to derive the actual parameter classes. These two components are then 
combined into the final LENS robustness transformation, and some simple example 
situations are explored to demonstrate its operation. 

3.3.1 LENS Parameter Classification, Part 1: 
Beamforming significance of j3 

In order to classify a LENS parameter as either target-canceling or jammer-canceling, 
it is necessary to understand the significance of 0 as. it relates to the overall system 
beamforming behavior. This relationship is stated as a fact for the two-element array 
of Section 3.1 [Equation 3.3], but it is more complex for general, A/-element array 
architectures. 

For general array architectures, 0 and I£lENS,m(£) are related by the fact that 
0 describes a basis for the null-space, Af[K LENSM (0)l of I£lENS.a/(£), which in 
turn describes the source-to-array transfer functions that are nulled by KlenS,m(P)- 
Given 0 = [0i,0 2 ,.. -,0m-i] T , this basis consists of the vectors 



i = {1,2,...,M-1}. (3.12) 



To see why {£,(/?)} forms a basis for M[Klens,m(£)1 consider the following: 

L • A/ II^LENS.m(/?)] is an (M - l)-dimensional space: This arises from the fact that 
the null-space of a single M-element vector is always (M - l)-dimensional. 
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2. span[V,(/?)] is an (M - l)-dimensional space: Use the M — 1 vectors ]£(/?) and 
the vector //target to form the columns of an M-by-M Vandermonde matrix. As- 
suming that the /?,• are unique , then this Vandermonde matrix is non-singular, 
and its columns, including the (/?), are linearly-independent . These M - 1, 

5 linearly-independent Vj(0) then span an M — 1-dimensional space. 

3. span[]/-(/?)] C ^[Hfr E NSjtf . It can be shown that each is 
an element of ^[J£ LENS(A/ (^)], i.e., that I£ L ENSjv/(2)"^(£) = °- For this 
reason, any vector that may be expressed as the weighted sum of Y_i(0) - that 
is to say any vector within spanf]^/?)] - is also within -A/ P [W^LENS f A/(^)]- 

10 The only way that one (M — l)-dimensional space may contain another (A/ — 1)- 
dimensional space is if the two spaces are equal, and so these three properties reveal 
that span[]/ (/?)] = A/7I£lENSji/(£)]* This is equivalent to stating that the vectors 
Vi(§) provide a basis for Af\W LENSfAf (£)]. 

This leads to the conclusion that the beamforming weight vector W£lenS,m(/?) 
15 will null any source-to-array transfer function IL(9,<f>) for which there exists a set of 
complex coefficients, {c t }, such that: 

M-l 

Since the target-to-array transfer function 2£target = 1 Is known, it is possible to use 
the V^P) to determine how 'close' //target is to -Af [S£lenS,a#(£)] = span[]/(/?)] and 
20 to define the desired LENS-classification regions T, J, and TUj. Before proceeding 
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with this proces^^^vever, it is interesting to consider ttB^>ecial case of ULA beam- 
former architectures with far-field sources, which display a convenient correspondence 
between the LENS parameters and the beamformer null locations. 



Special Case: ULA Architectures 

Recall the ULA source-to-array transfer functions for far-field sources 





1 




1 




gju/T(0,tf) 






ILula(0,4>) = 


^ e jW(9,p)j 2 




H x {0,J>Y 











where r(0, <j>) is the additional temporal delay experienced by a source from (0, 4>) 
when traveling from array element i to array element (t + 1). It turns out that, for 
this special type of source-to-array transfer function, W£lENS,m(/?) nu ^ s on ly source 
locations with K(9,<i>) exactly equal to one of the basis vectors 

(3.15) 

for some i € {1,2, . . . ,M — 1}. 

The <*= property of this relation is straightforward to see: since Yi{0) is a basis vector 
for Af[K LENSM (P)] then EvlaW, <f>) = J6(£) is clearly within M[W IENSm (§)}. The 
=*> property is less obvious, however. Consider the M-by-M A matrix formed using 
the M - 1 vectors V_i and the vector Hjj LA (9, <f>) € -^(I£LENS.Ar(£)]: 

A =[y i (§) I ••• I VW£) | BulaWA)]' 

Since {&(£)} forms a basis for M[W LE ^ S<M (£)], then &j LA (0, <f>) € M[K LENSm (£)] 
must be linearly dependent upon the which means that A is singular. Given 

the structure of ]/•(/?) [Equation 3.12] and £ula(0,4>) [Equation 3.14]), then A is a 
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Vandermonde matff, which is singular only if two of its coTimns are equal. Since 
the 0i and are unique, then the Vandermonde .4 is singular only if KulaW, <t>) = 
V, .(/?) for some i, which proves 

By equating the elements of UP) and Hl$, cf>), Equation 3.15 yields 



for some i 



i = l,2,...,M-l, (3.16) 



which may be re-written as: 



0i = cot ( — ^ j , for 



some 



i = l,2,. ..,M-1. 



(3.17) 



Solving this relationship for each /?, reveals that ]£ L ENS,v(£) nulls sources with 



lving 

locations that satisfy: 



(^,^) = r- 1 (5cot- 1 A), i = l,2,...,M-l. 



(3-1S) 



Note that these results match those stated in Equation 3.4 for two-element arrays 
Given that (3 minimizes the expected beamformer output [Equation 3.S], then 

!£LENS,.\/(£o Pt ) should nul1 the non - tar e et sources in the environment - This 

knowledge together with Equations 3.17 and 3.18 suggest that the g^. are, in some 
sense, a set of non-target location estimates. 

It should be noted that the special ULA relationship between the physical null location 
for W LENSM (fi) and the LENS parameter set fi holds for any array architecture that has 
a source-to-array transfer function of the form: 



#i(M) 2 



M-l 
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Generally, only free-field ULAs will exhibit this form of source-to-array transfer 
function for all source locations. For other arrays, however, it is possible to pre- 
process the array input to yield source-to-array transfer function structures that are 
similar to the ULA structure for a subset of source locations that are of interest for the 
particular beamforming application. 

In this case, H(9,<f>) € M[W LENS ,m(§)] when 

K{0, = i = {l,2,...,M-l}, 

which leads to nulls at locations that satisfy 

* l(M ) = |±i ( ,^ i) = ^(Mj), ; = { i,2,...,m-i}. 

Note that, by setting ffi(M) = 0, this result yields Equation 3.3 as stated for the 
two-element array in Section 3.1. 

3.3.2 LENS Parameter Classification, Part 2: 
Generating Parameter Classes 

Given the preceding relationship between £ and I£LENS,Af(£)> »t is now necessary 
to develop the classification procedure that labels LENS parameters as either T, 
J, or TU J. This classification is achieved by measuring the impact of /?,• upon the 
'closeness' of the assumed fr^ to Af[K lENS , M (0)]'. (1) if # <*uses JV[I£lENS,a/(£)] 
to be close to tf^et, then # is considered to be target-canceling, i.e., # € T, (2) if 
fa causes A/"[]£lENS.m(£)] to be far from fUget, then A is considered to be jammer- 
canceling, i.e., /?,• € J, and (3) if/?,' causes AT[]£ L ENS.Af (£)] to be an intermediate 
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distance fr°m Kt^j^ then /?,• has an intermediate effect^|^[, # € T U JT. 

Distance Metric, 

One convenient distance measure between A^[]£lens,a/(£)] anc * ^target is fc he angle 
between the subspace and the vector. Figure 6 shows the concept of Q for 
a hypothetical subspace S and a vector Z. where Z has been separated into two 
orthogonal components, £ S and Z - Z5 ± 5, that sum to form Z. When fi = 0, 
then Z^ = Z, which means that <S contains Z entirely, and the distance is 0. On the 
other hand, when Q = 90°, then Z5 = 0, which means that S contains no information 
about Z. and the distance is maximal. 



In practice, the dependence of 0(/?) upon /? is complicated, and it is difficult to 
determine the impact of an individual upon this metric. It is possible, however, to 
define a set of metrics, {ft t *(/?)}, where Q t (/?) is equal to the angle between target 
and the span of the single null-space basis vector Yj(0): 

SI-IB) = cos" 1 ( l - l0)HlJ \ - cos- 1 ( ^W H U \ 
*M£J cos { mm n^ arget( | 2 ; - cos { m{g ft b j B ) , 

z = {l,2,...,M-l}, 

where | • | is the standard complex scalar magnitude, || • || 2 is the Euclidean complex 
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vector norm , aiflRe second equality comes from the^fewledge that #target — 1 
and that | ^target I b = VM. Although the set {^(0)} does not provide as.accurate 
a distance measure between 

.VTC L ENS.Af(£)] and target as that provided by 
it does provide a general idea of this distance. Additionally, it has the advantage 
of being relatively simple and of measuring the effects of each LENS parameter /?,- 
individually. Note that, like ft t (/?) ranges from a minimum-distance value of 0° 

to a maximum-distance value of 90°. 



Ideal Parameter Classifications 

10 The metric Q t -(/?) serves as the vehicle through which 0 optf i is classified. Figure 7 

shows contour plots of fl t (/?), as /?,■ varies over the space of complex numbers, for cases 
of M - 2, 3, 4, and 5 array elements. Specific contours indicating = 30°, 60°, 90° 

are shown. Note the following properties of the metric and the information that 

it contains about /?,■: 



35 



1. Q{(0) achi^^its maximum value of 90° at prec^| M - 1 points, known as 
the 'orthogonal 1 values of &: k = {1, 2, . . . , M - 1}. At these values, the 
span of the individual V^fi) is orthogonal to target, and # is considered as 
containing jammer-canceling information only. 

5 

2. Qi(P) 0° as \(3 { \ -> oo. At these values, span[V,-(/?)] practically contains 
^target i an d Pi is considered as containing target-canceling information only. 

3. ttiid) decreases regularly as the distance between pi and the orthogonal values 
10 increases. At these intermediate values, # contains both target-canceling and 

jammer-canceling information, with parameters near to 0£ being more jammer- 
canceling and parameters with large |#| being more target-canceling. 

These observations suggest the following classification of 

i5 nj<ni(P) =► Aejr, (3.20) 

nj<ni(0)<n T fceruj. 

Figure 8 indicates the three classification regions for an M = 3 element array when 
Qr = 30° and flj = 60°. Note that the specific values of Qr and ft y used in a specific 
LENS implementation will depend upon the array architecture and the frequency of 
the narrowband bearaformer input. Boundary selection is discussed in more detail 
20 below for the case of ULAs. 



A note on the 'orthogonal' values of It is possible to calculate explicitly the 
M - 1 orthogonal values of # that result in fl(Pi) = 90°. Specifically, these are the 
Pi that yield V^/?)*! = 0. Defining a { = j|±J and recalling the structure of V^P) 
25 [Equation 3.12], this requirement may be written as: 

A/-1 
i=0 
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This polynomia^^* t * is equal to 0 when 

a { — e j2 ^, k— 1,2, M — 1. 



Solving a; for Pi yields the orthogonal values of 

# = cot^ f fc = l,2,...,Af-l. (3.21) 

An interesting side observation here is that the (M - l)-element LENS parameter 
vector that consists of these orthogonal values, P L = [Pt.Pti • • • iPm-iV-* yields a 
LENS weight vector that is equal to the uniform-weighting vector: 

!&ENS.„(2 X ) = jf [ 1 1 - l] T => 

This result reinforces the choice of Q t as the /?,- robustness metric, since the white- 
noise gain of W = ^1 is = ^j^r = M [Equation 2.15]. This is the maximum 
possible white-noise gain value for a weight vector that preserves /f targf>t = I with 
unit gain, which means that it achieves very robust beamforming. 

Practical Parameter Classifications 

In practice, the contours of constant fi t *(/?) are complicated and the preceding classi- 
fication procedure can be difficult to implement. In order to yield a practical system, 
this research simplifies the problem by approximating the contours as boxes, cen- 
tered at Pi = 0. Empirical observations demonstrate that boxes with the following 
proportional relationship yield reasonable matches to the desired contours: 

Height \Im{£}\ A(R) _ 

Width \Re{(3}\ R R ' [6 ~- > 

where (3^ = cot ^ is the largest orthogonal ft- value, as defined in Equation 3.21, and 
where the box half-width R lies between /?/- and oo. Based on A(R), the rectangular 
approximation becomes square as R -¥ oo and a flat line extending from real values 
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~0\ = Pii-i to^^as R -> ft. This reflects the beh^lr of the true contours of 
ft,, which become circular as Q t 0° and which converge to the M — 1 points ft, 
k = {1, 2, . . . , M - 1}, as ft, -f 90°. 

Figure 9 demonstrates the relationship between the real and approximated con- 
tours of constant ft (/?,•) for an M = 3 element array. As shown, the boxes yield 
reasonably good approximations to the actual contour curves, especially as ft, ap- 
proaches 90°. Similar results are obtained for other values of M. 

Given the box-approximation to the contours of constant ft,-, the LENS parameter 
classification from Equation 3.20 may be re-expressed as: 

IMA}I > Rt OR |/jn{A-} I > A(Rt) 0i 6 T, 

\RH0i}\ < Rj AND |MA}I < A(%) =^ A € J, 
\Re{/3i}\ > Rj OR |/m{/?,}| > A(Rj) ] (3.23) 

and > =*► AerUJ, 

IMA} I < Rt and IMA-} I < MRr) 

which is shown graphically in Figure 10. The values of R T and Rj yield classification 
boundaries that are close to those obtained using ideal contours at ftr and Qj in 
Figure 8 . By definition, T and J should be non-overlapping, which is satisfied if 
R T > Rj. In this case, the boundary-selection process becomes that of choosing Rj- 
and Rj rather than that of choosing Q T and i7 j. These choice are explored in more 
detail below for ULAs. 



Special Case: Broadside ULA Architectures 

This section explores the process for determining the specific values of R r and Rj 
for the special case of broadside ULA systems. 

Section 3.3.1 demonstrates that, for ULAs, there is a correspondence between the 
LENS parameters # and the beam-pattern null locations. Specifically, the parameter 
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0i produces a nul^^the location (0 t ,<&) that satisfies 



0i=cot (^my (3 . 24) 

where r(0, cj>) is the inter-element delay experience by a source from the (9, <t>) location. 
Equation 2.7 may be used to show that ULAs that are oriented broadside to the target 
signal have inter-element delays with the structure 

r(^0) = ^sintf, (3.25) 

where 9 is the angle between the source propagation direction and the plane perpen- 
dicular to the array axis [Section 2-2]. Note that r(9,<f>) depends on 9 only and not 
on <f>, due to the cylindrically-symmetric array behavior about the array axis. 



10 Equations 3.24 and 3.25 provide a convenient means for determining the target- 

canceling and jammer-canceling region boundaries that are used in the LENS classi- 
fy fication procedure above. Specifically, a # that produces a null within an angle 9r 
: 4 of the target location is labeled target-canceling, while a # that produces a null at 
an angle greater than 9j from the target location is labeled jammer-canceling. Given 
f 15 that the target location is 9 T = 0, these requirements may be expressed as: 

t Target-Canceling: \0 { - 9 T \ < 9 T |/? t | > cot (ff sin0 r ) , 

3 Jammer-Canceling: \B { - 9 T \ > 9j |#| < cot sin0j) . 

By comparing this classification to that proposed in Equation 3.23 and by noting that 
0i are assumed to be real for Equation 3.24, then this argument suggests that the 
desired robustness regions could be achieved using: 

/?r = cot(£sin* r ) 

20 / j \ (3.26) 

Rj = cot [*gsm 9 j) . 

As long as 9 T < Oj, these values will yield three distinct LENS classification regions 
as shown in Figure 10 and described in Equation 3.23. This research uses these 
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-^Hf Rj, with 0 T = 15° and 9 7 = 30°. 



formulae for R t tK Rj, with 9 T = 15° and 9j = 30 

In practice, both upper and lower limits are imposed upon Rr and Rj. The 

upper limit restricts any unusually large ft values, which prevents very large values 

of the weight vector norm, I^ENS.a/C/^IIIlENS.a/C/?) 311(1 prevents excessively small 

values of the system white noise gain G w = ^ TaTTTTv m [Equation 2.15]. 

—LENS ,m l£) — LENS ,m (§) 1 M J 

It must be noted that the precise relationship between /? and the weight vector norm 
is complex, and so the upper bounds on Rr and Rj are not designed to restrict 
I^LENS.mC^^IElenS.a/C/D to be below a specific value . This research uses Rr < 30 
and Rj < 10, which have been determined empirically to yield good performance. 

The lower limit on R T and Rj ensures that the LENS parameters always has 
a minimal amount of 'maneuvering room' about the orthogonal parameter values 
ft = cot ff> & = {1 5 2, ...,M — 1}. The precise impact of these lower bounds is 
difficult to derive, and this research uses R T > ft + 2 and Rj > ft + 1, which have 
been determined empirically to yield good performance. 

Together, the upper and lower bounds on Rr and Rj for this research are: 

ft + 2 < R T < 30 

(3.27) 

ft + 1< Rj < 10. 
3.3.3 Final Transformation: 3 x -> 3 . 

i— opt C—rob 

Given the LENS classification procedure above, it is possible to state the actual 
/?, p< £. o6 transformation, based on Equation 3.11: 



ftob,i = < 



o ft*,, € r 

Po P t,i ft P t,i € (3.2S) 
F[ft P t,i] 0 op t,i 6 TUT 



The first two components of this transformation are straightforward given the 
classes T and J. For the third component, recall that F[f3 opt ,i] should be a smooth 



AO 



transition betw^^ne /? optt , 6 T and 0 opU i € J extrenlft^or the box classifications 
of Equation 3.23 [Figure 3-7], one possible F[f3 QpU ] is: 




F[0o P t.i] = min 



\Re3 opUi \ - Rj \Im3 0pt .i\-A(Rj) 



Rr-Rj ' A(R T )-A(Rj) 



0opt,ii 



(3.29) 



where f[(3 opUx ] = 1 for (} opt%i on the border of the J, f[/3 opt%i ] = 0 for 0 opUi on the 
border of the T, and /[/? op t,t] linearly moves from 1 to 0 as either Re[/3 0pt ^] progresses 
from Rj to R T or /m[^ opt ^] progresses from A(Rj) to A(R T ). Given this F[/? opU ], 
Equation 3.2S may also be expressed as 



Prob.i = f[0o P t,i]Popt,u where f[3 opt ^] = < 



3.3.4 Example Cases 



0 0 op t,i € r 

1 /?opm € JT (3.30) 



In order to gain some understanding into how the LENS robustness restriction actu- 
ally operates, this section presents some simple examples based upon a two-element 
array with an element spacing of d = 0.07 m. This array is oriented broadside to the 
target location, which means that no steering delays are needed to make ILc^ et = I- 
Assuming far-field sources, then Equations 2.6 and 2.7 may be combined to yield the 
source-to-array transfer function expression: 



me, 4>) = 



1 




l 









where an acoustic propagation velocity of c = 345 m/sec has been used and where 6 is 
the angle between the source propagation direction and the plane that is perpendicular 
to the array axis [Section 2.2.1]. In the azimuth plane, 9 may be interpreted as the 
angle to the left of the assumed target location. 

Given this array, consider the following four source situations, where a single 
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source, with som^^D-array transfer function #*, doirJ^es /?* pU . The values of 
0o P t,i that yield W.iEXS,M(0opt.i) H IL h = 0 are also given, as determined from Equa- 
tion 3.3. Note that a perfectly-aligned target source, with H_(9,<j>) = 2£target> * s not 
considered, since, by definition, IElENS^A) cannot null this location. 

1. / = 500Hz. 10° mis-aligned target, matched array elements: 



H l = 



4i = 18.01. 



"-• / = 500 Hz, aligned target, mis-matched array elements: 



H 2 = 



0.9 



/?* = -J19.0. 



3. / = 500 Hz, 45° jammer, matched arrav elements: 



H 3 = 



1 



= 4.36. 



4. / = 500 Hz. 45° jammer, mis-matched arrav elements: 



H 4 = 



0.9e J?ciOoH2 « O w sin45 ° 



= 4.13 -./l.O. 



Figure 1 1 plots these four /?* pU values as well as the LENS robustness regions for 
/ = 500 Hz, defined according to the R r and Rj of Equation 3.26 with 9 r = 15° and 
9j = 30°. 

These plots demonstrate the LENS robustness restriction at work. The target- 
canceling LENS parameters, (3 l opt l and fi pt l , lie in the T region, which means that the 
robustness restriction transforms them to the neutral value of /?* oM = #? o6 1 = 0. On 
the other hand, the jammer-canceling LENS parameters, /?J, M and 0* ptA , He within 
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The Overall LENS Algori^i 

Figure 12 summarizes the overall LENS algorithm. Since this 

research will study ULAs that have been oriented broadside to the target location, 
the robustness transformation boundaries derived in Section 3.3.2 will be used: 

Rt = cot (g sin 15°) , ft + 2<R T <W, 

/ J ; subject to 1 (3 31) 

^ = cot(^sin30«), ft + KRj<10, 1 ' 

where d is the inter-element array spacing, c is the propagation velocity, and ft j s 

the largest magnitude orthogonal value [Equation 3.21]. 

One LENS feature is immediately obvious when comparing LENS to traditional 

CMV processing from Section 2.3.2: LENS separates the robustness constraining pro- 
cess from the beamforming power minimization, while CMV combines the robustness 
constraints into the beamforming power minimization. It is the separation of these 
two components that allows LENS processing to exhibit direct and flexible control 
over the beamforming. 
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Modified LENS: Skew LENS Processing 



Skew LENS processing is a relatively simple modification of standard LENS pro- 
cessing. Specifically, it consists of the following four steps: 

= 1. 

^— mi £ci. — • 

form the skewed input signal X_r = ZX_, where: 



1. Given the standard LENS input, which has been steered to have H_t*r&et 



Z = 



1 0 

o C 



0 



o C 



A/-1 



(5.1) 



The matrix Z is the skewing matrix and C IS the skewing parameter. 

2. Generate the optimal skewed LENS parameter set ^ QVi based on X^, i.e.. use 
the standard LENS definition [Equation 3.8], with #a' c A' c rather than Rxx- 
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3. Restrict 



. for robustness to form 0^. ro6 . 



4. Form the weight vector WleNSj/(£; anc * use '^is to f° rm '^e keamformer 
output Y = i£ L ENS.,u(^. ro6 )^- 

Given this description, it is clear that Skew LENS reduces to standard LENS pro- 
cessing when C = 1 and Z becomes the identity matrix 

It is very important to note that the optimal Skew LENS parameter set, t i IS 
defined using the standard LENS definition [Equation 3.8] applied to i.e., 0^ 
is designed to preserve sources with K{Q,<f>) = I- Given the Skew LENS definition, 
however, it is clear that the assumed target location now has a transfer function of 



i£<, target — Zl 



1 

c 



Af-1 



(5.2) 



which means that /?, may actually cancel the assumed target location! As described 
below, however, the introduction of this controlled and very structured error into 
target concentrates target-canceling beamforming information into a single LENS 
parameter, which can improve the overall LENS performance. 

The following sections present the logic behind Skew LENS processing, discuss the 
selection of the skewing parameter develop a modified LENS robustness restric- 
tion for Skew LENS processing, and present complete Skew LENS description. 



5.1 Skew LENS Basics 

For the special case of idealized narrowband far-field sources with a mis-aligned target, 



45 



LENS algorith^^i n completely separate the target-J^^ling and jammer-canceling 
beamforming effects within the optimal LENS parameter set. This allows LENS to 
prevent target cancellation without limiting jammer cancellation, which results in ar- 
ray gain levels that are nearly-equal to those observed with a perfectly-aligned target. 

For all other array environments, LENS cannot completely 
separate target-canceling from jammer-canceling information in the optimal LENS 
parameter set. This means that LENS cannot restrict target cancellation without 
simultaneously limiting jammer cancellation, which prevents LENS from maintaining 
near-ideal performance levels. Skew LENS processing is an attempt to increase the 
separation of target-canceling and jammer-canceling information in the optimal LENS 
parameter set for all array environments and for all sources of target-cancellation. 

Skew LENS processing achieves this goal through the skewing matrix Z. Specif- 
ically, Z concentrates the possible target-canceling LENS parameter values into a 
relatively small subset of the overall LENS parameter space. By concentrating the 
range of possible target-canceling LENS parameter values, Skew LENS processing al- 
lows these values to be covered by a single LENS parameter. This frees the remaining 
parameters for jammer cancellation and increases the separation of target-canceling 
and jammer-canceling information within 8, 

To see how Z concentrates target-canceling LENS parameters, recall the behavior 
of these parameters. Section 3.3.1 shows that 0 describes a basis, {]£,(/?)}, for the 
null-space .^[KleNS,m((DI of !£LENS,A/(£)> where 



my 



Af-l 



, i= {1,2,...,M-1}. 



A target-canceling LENS parameter, corresponds to a V^iP) that is close to the 
target- Apply this observation to standard and Skew LENS processing: 



46 



1. For stano^^LENS, [Ft ar5et = I], this closeness ^^rs when 

IAI "> oo. 

2. For Skew LENS, [/^ >target = Zl] this closeness occurs when 

assuming £ ^ 1. 

Now, assume that the actual target-to-array transfer function, Kx,^^ is near to, but 
not equal to, Kt^t = L For standard LENS, as iLu-get varies from ^t arget , it is clear 
that that the target-canceling LENS parameters will cover the entire large- 1#| region. 
For Skew LENS, on the other hand, as ^target = garget varies from ^.target, it is 
clear that the target-canceling LENS parameters will be clustered about 0 { = j^f 
This demonstrates that, as desired, Skew LENS concentrates the target-canceling 
LENS parameters. 

5.2 Selecting the Skew Parameter, £ 

The Skew LENS parameter, f , determines the amount of concentration that Z in- 
troduces into the target-canceling LENS-parameter values and the overall ability of 
Skew LENS to separate target-canceling from jammer-canceling information. In gen- 
eral, as £ deviates further .from the non T skewed case of Q = 1, more skewing and 
more concentration occur. Care must be taken, however, when selecting and the 
following rules should be observed: 

1. C should not yield ZH(0,<f>) = 1 for any non-target (0,<f>): 

Since that 0^ is defined using the standard LENS optimization, it preserves 
sources with source-to-array transfer functions of ZH(9,<f)) = L Given the 
beamforming goal of jammer signal attenuation, it is clearly undesirable for Z 
to map a jammer source to have ZH_(0, <f>) = L 
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10 



5 



Consider^^an example broadside ULAs. As^^vn in Equation 2.6, these 
arrays have non-skewed source-to-array transfer functions of the form: 



1 



0 MM-l)T X (8,<t>) 



where r{9, <p) = ± s in#, d is the inter-element spacing and c is the propagation 
velocity. Given this &(9,<t>), a skewing factor of (," = e " iur ^ 1 '^ would yield 
ZH(9i,<f>i) = I, and that Skew LENS would preserve sources from the (9 u a>i) 
location! For ULAs. ZH_{0,<})) = I is avoided when \Q ± 1. 

-• C should not skew the processing excessively far from standard LENS 
processing, i.e., [C - 1| should not be too large: 

As C deviates further from the non-skewed Q = 1, the concentration of the target- 
canceling LENS parameter values increases. Unfortunately, if;" deviates too far. 
then the skewing also begins to concentrate the jammer-canceling information 
into the same set of LENS parameter values. This reduces the separation of the 
target-canceling and jammer-canceling information. 

Consider as an example the broadside ULA situation from above, which has the 
non-skewed source-to-array transfer functions given above. At low frequencies, , 
the delay term T{6,<j>) is small for both target and jammer locations, which 
means that H_(9, cf>) is always 'near' to = 1 . A skewing parameter that 

deviates largely from C = 1 masks entirely the e^ T <W term in ZH(9, 0), which 
means that the jammer-canceling LENS parameter values for this location are . 
concentrated together with the target-canceling LENS parameter values. Em- 
pirical observations conducted for this research suggest that < 0.05 avoids 
excessive concentration of jammer-canceling LENS parameter values. 



For this research, Skew LENS is implemented with f = 0.95. 
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5.3 Sk^|LENS Robustness R^hriction 



As described above, Skew LENS processing applies the skewing matrix Z to the 
standard LENS beamformer input, 2L, in order to concentrate the possible target- 
canceling LENS parameter values into a relatively small subset of the LENS parameter 
space. Since this transformation re-maps the target-canceling and jammer-canceling 
LENS parameter regions, it is necessary to re-define the LENS robustness regions T, 
J , and T U J (target-canceling, jammer-canceling, and intermediate, respectively) 
that are used in the LENS robustness restriction of Section 3.3. 

Such a re-definition would be a time-consuming and rather difficult procedure, 
but, fortunately, there is. a relatively simple means of by-passing this problem. It is 
possible to convert 3 into the non-skewed LENS parameter set 3 , for which 
the target-canceling and jammer-canceling LENS parameter regions are mapped back 
to their original, non-skewed, standard-LENS locations. This 3 may then be 
restricted for robustness using the standard LENS procedure of Section 3.3 to yield 
£>s roo' ailcl this resuIt ma y be 're-skewed' to form 3, L . 

At first glance, it may appear that this non-skewing transformation negates all 
of the beneficial effects of Skew LENS processing and that may simply equal 

the original, standard LENS parameter £ p< . This behavior is not, in fact, true - all 
beneficial effects of Skew LENS processing arise out of the actual power minimization 
that yields ^ and the non-skewing transformation is simply a tool that assists in 
the robustness restriction to form 3 



5.3.1 Relationship between /3. and the Non-Skewed J3 



'—as 



A Skew LENS parameter set /?, and its non-skewed counterpart (3^ are considered 
equivalent if they describe the same beamforming behavior. Specifically, these two 
parameter sets will be considered equivalent when the beamforming accomplished by 

— LENS.Af (^-)^2C< = KLEXSMi^ZX 
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t<^^ beamforming accomplished by 



is equivalent t<^^ beamforming accomplished by 

KLESSja(iJ2L 

where Z is the skewing matrix of Equation 5.1 and the relation = ZX_ has been 
used. Such beamforming equivalence is attained when 

Aqz"l£ LEN s, A ,(£.)] = ^LENS,m(£J] (5-3) 

Equation 5.3 is true when /?, and 0^ are related using 
the following transformation pair: 



Skewed => Non-Skewed /?„,,, = j ^XT-^YX?) 



(5.4) 



Non-Skewed Skewed = j ^;^^^ 

5.3.2 Skew LENS Robustness Restriction Summary 

Figure 13 presents the overall robustness, restriction process for Skew LENS pro- 
cessing. It consists of the standard LENS robustness restriction nested between the 
0, 0 * and 0 , 0 * t transformations. 



5.4 Overall Skew LENS Algorithm 

Figure 14 shows the overall Skew LENS flow diagram. This resembles the standard 
LENS flow diagram from Section 3.4, but it adds the input-skewing step as Step 1 
and modifies the LENS robustness restriction as described by Figure 13 . 
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6 LENS Implementation 



The main computational component of either standard LENS [section 3] or Skew 
LENS [ section 5] processing is the determination of the optimal LENS parameter set, 
P^ pt or Once this optimal parameter set has been determined, it is a straight- 

forward process to restrict the parameters for robustness and to generate the final 
beamforming weight vector. This chapter develops and simulates two implementa- 
tion methods that use the temporal stream of narrowband array input observations. 

to form a running estimate jfi^ of the optimal LENS parameter set. Note 
that, although this chapter uses the terminology of standard LENS processing, the 
identical methods may be used to obtain ^ from {-Y< '} for Skew LENS processing. 

Recall from section 3 that the optimal LENS parameter set is defined as the 
parameter set that minimizes the expected beamformer output power that arises 
when using the LENS weight vector I£leNS,a/ 

where R X x = E[ XX H ] is the input covariance matrix and P[j3] is defined to be the 
expected beamformer output power. As shown in Section 3.2.1 [Equation 3.10], the 
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# . . • 

closed-form soluron to this optimization may be written as 



■ - roots • (6 - 2 » 

where the operation roots(;?) returns the set of roots for the polynomial with coeffi- 
cients given by the elements of the vector p. 

Since Rxx is unknown and time-varying, Equation 6.2 generally cannot be used 
to generate a single 0^ that describes the entire input. Instead, 0^ must be es- 
timated actively from the temporal stream of input observations, {2l (/) }. The most 
obvious LENS implementation would use {2L (l) } to formulate a time-dependent input 
covariance estimate R$ x , which, through Equation 6.2, would yield a time-dependent 
optimal parameter set Unfortunately, the matrix inversion and polynomial root 
calculation render this system computationally expensive in practice. This chapter 
develops two alternative, iterative solutions to the LENS optimization of Equation 6.1 
and uses these solutions to develop actual LENS implementations. 

Relaxation Approximations 

This class of adaptive solution arises out of the Gauss-Seidel relaxation-iteration 
for linear systems of equations and solves Equation 6.1 by cycling through 
the LENS parameters and minimizing P[0j with respect to each /?,• individually 
while holding the remaining /? m , m ^ z, fixed to their most recent values. 

Gradient Approximations 

This class of adaptive solution calculates the gradient of P[0j with respect to 
the individual # parameters and follows the gradient to minimize P[0}. 

6.1 Useful Formulae: ««,§fl iand ^. 

Before developing the Relaxation and Gradient LENS implementations, this section 
presents expressions for the partial derivatives ^r^, and ^j^, where 

Pi = + These partial derivatives are required for the development of both 
iterative LENS solutions. 
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Given 




£3 5 



^ 10 



15 



|g = 2B Rti + 20kG, 
d ^ = -2B U + 2/?„C t , 



(6.3) 



where the parameters 5, and C, are given by: 



^ = 7 [ 0 £LENSj/.i(£)" ] T^R XX T M 
C > = \ [ 0 £lens.a/,(£)" ] TmRxxTm 



0 
0 

. ££lENS.A/,«(/?) 



(6.4) 



In this definition: (1) T M is the transformation matrix from Equation 3.7 that trans- 
forms the LENS beamforming weight vector ]£lenS.a/(£) into the alternative beam- 
forming weight vector £ L ENS,.\/(/D [Appendix B] and (2) £ LENS M •(/?) is a vector 
that is entirely independent of /?,• and is defined to be: 



£lens>/,,(£)" = (j) <fa ['i A )*•••*[ 1 

[ 1 ft+i !*••■*[ 1 /fo-i ]. (6.5) 
Note that LLiexS.mW) [Equation 3.6] and ££[,ENS,A/,« are related through /?,: 

Oleksy (£)" = i [ UlensmA®* o ] + f [ o SUensmAS)" ] ■ ( 6 - 6 ) 
6.2 Relaxation LENS Implementation 

Relaxation LENS processing solves for 0^ iteratively by cycling through the LENS 
parameters one-by-one and minimizing Equation 6.1 with respect to each ft individ- 
ually, while holding the remaining parameters fixed. This process is based upon the 
idea of the Gauss-Seidel iteration to solve linear systems of equations. 



53 



In order tc^J^strate how this relaxation iteration^^rates, this section begins by 
exploring Equation 6.1 in the case of a known and fixed input covariance matrix Rxx- 
It then generalizes the result to yield the Relaxation LENS implementations that 
combine the relaxation iteration with a time-dependent input-covariance estimate 
^xx to generate a time-dependent optimal LENS parameter set estimate 

6.2.1 Covariance Relaxation 

Recall the basic LENS problem from Equation 6.1: . 

0 = arg min PU31 

The relaxation LENS solution to this minimization may be stated as follows. 

1. Initialize the process with an arbitrary parameter vector ^ JO], such as the 



orthogonal LENS parameters £ x [Equation 3.21]. 



2. Update 0^ pt [k\ into + 1] by cycling through the LENS parameters 0 { 

exactly once and minimizing P[0] with respect to each 0i while holding the 
remaining 0 m , rn j£ i, fixed at their most recent values: 

foptAk + 1] = arg min P{/3]\ . (6.7) 

°ft€C —l/?m,m^t fixed as desired V ' 

Consider this update process in detail for an arbitrary /?,-. Since updates have 
already been performed for 0 m , rn < i, the most recent values of 0 m , m ^ i are: 



0m = { 



0o P t,m[k +1] rn < z, 

0opt,m[k] rn > i. 



Given these fixed 0 m ,m^ i, it is possible to form B { and C t [Equation 6.4] and 
to use these to define and %M [Equation 6.3]. Since 

d*P[0] ^d>P[0] 
d0h 901 - c ^ 0 '- 
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then the softrtion to Equation 6.7 is obtained by setting and to 0 and 
solving: 

Jgg = 2£«„- + 2^„C,- = 0 
gjj = -2B U + 2P u Ci = 0 

This yields (3 0v tj[k + 1] = — ^- to solve Equation 6.7. 

As k -> oo, ^pjfc] converges to the true underlying [as demonstrated by the 
simulations in Section 6.5.1]. Figure 15 depicts the overall LENS relaxation iteration 
process. 



6.2.2 Relaxation LENS Processing 

Now that the basic concept of the LENS relaxation iteration in the case of a known 

and fixed input covariance has been derived, it is necessary to modify the iteration 

to suit the more realistic situation in which the input covariance is unknown and 

time-varying. This is achieved by using the temporal stream of array inputs, {AL^}, 

to form a time-dependent estimate f6 xx of Rxx* 

The most direct Relaxation LENS implementation would use each F$ xx to form 

* (0 

a corresponding P[0y ' and would apply a full relaxation solution until 0^ has been 
generated to the desired precision. Assuming that the relaxation iteration converges 



to the true solution to Equation 6.1 (this is demonstrated below), this system is 

* (/) n\ 

equivalent to one that uses Equation 6.2 directly to generate {3^ from R xx . Unfor- 
tunately, this implementation has the disadvantage that it requires several iterations 
to obtain each , which may be computationally demanding. 

Simplified adaptive relaxation implementations result by realizing that r!" xx is 
correlated with R x ~x^: many of the same input observa- 

tions go into the averages that form R^ xx and P6j^ x \ For this reason, and / * 
are generally 'close' to one another. The number of relaxation iterations required to 
obtain can be substantially reduced by using t ^ as the initialization for the 
iteration to solve for /?^. In fact, if ^ is sufficiently slowly-changing, then it is 
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possible to upcj^^Dnly a fraction of the LENS parajj^s at each input step while 
maintaining reasonable solution accuracy. 

Figure 16 shows two possible simplified implementations, using the notation 
RMPoptJ to denote a relaxation iteration update of the parameter 

!* The Complete Update svstem updates each of the M - 1 LENS parameters in 
to yield . 

—opt •* i— opt 

'-• The Partial Update system updates exactly one of the LENS parameters in 
i^ pt £ o yield Note that for this system, care must be taken so that the 
relaxation update still cycles through all M - 1 LENS parameters. This cycling 
is achieved by updating parameter i = [1 + (/ mod M - 1)] at input step /. 

The primary trade-off between these two implementations is one of implementation 
complexity versus solution accuracy and adaptation speed. By updating only one pa- 
rameter per input observation, the partial update implementation reduces the compu- 
tations required by a factor of M - 1 relative to the complete update implementation. 
This reduced complexity comes at the cost of updating each LENS parameter only 
once every M - 1 input observations, which increases the system adaptation time to 
a changing environment and reduces the overall solution accuracy. As shown by the 
simulations of Section 8.5.2, however, the covariance estimate fitj} x generally changes 
slowly enough that this latter effect is minor and that Complete and Partial Update 
Relaxation LENS implementations yield nearly identical results. 



6.3 Gradient LENS Implementation 

Gradient LENS processing takes a different approach to solving Equation 6.1. Specif- 
ically, it calculates the gradient of P[/3j with respect to the LENS parameters and 
steps along this gradient until P[0\ has been minimized. In a manner similar to that 
of the previous section, this section develops gradient LENS processing by consider- 
ing the problem in the case of a known covariance matrix, and then generalizing the 
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result to yield ^^jradient LENS implementation thl^lnerates the time-dependent 

opt 



0\L for an unknown covariance matrix, 



6.3.1 Known Covariance Gradient Search 

Recall the basic LENS parameter problem from Equation 6.1, 



10 



15 



0 = arg min P[0\. 

The basic gradient-based LENS solution to this minimization may be stated as follows. 

1. Initialize JO] with an arbitrary parameter vector, such as the orthogonal 
LENS parameter set, from Equation 3.21. 

2. Update 0^ pt [k] into 0^ pf [k + 1] by calculating the gradient of P[g] at and 
taking a small step along this gradient toward the function minimum: 



where Equation 6.3 allows VP[8] to be written as: 



0=6 [k] ' 

— —opt L J 



(6.S) 



1 vpia = 


" ap[ff] " 

90R.I 
90R.2 


+ j 


' 9P[0] ' 

901.1 
9P\f3] 

901.2 


= 2 


B' x + Ad 
B' 2 +foC 2 




O.P{0] 




9P[0] 








. *0R,M-l -1 




. 90,, M -i J 





Using the definitions of B, and C, [Equation 6.4], the vectors UjlEHS,m(!Q 
U-LEXSmAP) [Equations 3.6 and 6.5], and the relationship between LLleNS..\i(§) 
and LLlenSmA@) [Equation 6.6], B' + 0id may be re-written as: 



1 

2 I 



!Lleus,mAP) h 

0 UuSiSMAfi) 7 ^A- T AV^LENS.u(^)", 
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where tl^^cond equality arises from the fact (B? + /?,C t ) r = B~ + #C t . 
This expression for B* + 0id yields: 



0 ILlwSjvM* 
0 £LENS,A/, 2 (£) r 

.0 £lENS,A/,A/-i(£) 2 



r LENS.A/ ( £> 



The step-size parameter fi in the gradient update [Equation 6.8J governs the over- 
all rate and quality of the iteration convergence. A larger step-size results in faster 
initial convergence towards the optimum, but exhibits oscillation about the optimal 
value (also known as misadjustment). A smaller step-size results in slower conver- 
gence but less misadjustment. It should also be noted that, if the step-size is too large, 
then this iteration may diverge. This research presents no proofs nor performs any 
investigations into the range of step-size that guarantees convergence of this LENS 
gradient-search. Simulations suggest, however, that the general gradient-based con- 
vergence rule 

Iteration a ^ 

Convergence E[2L H 2Q 

yields acceptable results provided that the parameter magnitudes, \0 op tA k ]\ 2 , » = 
{1? 2, • * * , M - 1}, are not too large. This research imposes the following modification 
upon the step-size in order to reduce the step size when the |/?o P *,i[&]| 2 are large: 

with .jr-m«li,S^*{aHC]. (6 ' 10) 

In this case, the parameter A' is restricted to be greater than 1 to ensure that it only 
shrinks and never enlarges fi[k]. 
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a^nt LENS Processing 



6.3.2 GraJ^nt LENS Processing 

The most direct gradient-search modification to accommodate an unknown and chang- 
ing input covariance would use the input stream, to form F&xx 

*m p *(/) 
to apply a full gradient search to each R xx to yield {3^ . Such a 

system would be inefficient, however, since gradient search iterations generally have 
long convergence times* 

A simpler implementation may be realized by synchronizing the gradient-search 
iteration to the input observation iteration. Specifically, use r! xx to generate the 
current gradient VP[0JW [Equation 6.9] and substitute this into Equation 6.S to 
update $ l \ into /3^t^- 

r * '■ — Opt Z—Qpt 

For this implementation, the time-dependent step-size parameter defined in Equa- 
tion 6.10 may be approximated by: 

A* (0 ' = F^TTT 0 < a < 1, 
with K = max[i, ^ M _^ ], 

where a 2 ^ is a running estimate of the total expected array input power, ^[A^^l]- 1 - 

In general, each update step in Gradient LENS processing (or in any gradient-based 
adaptive algorithm) is small. Therefore, the adaptive Gradient LENS processing does 
not require a highly accurate estimate of the input covariance to yield acceptable 
results. The Gradient LENS processing estimates i£as the instantaneous input 
covaraince: 
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This reflects the covariance matrix estimate used by the traditional Frost Process- 
ing and Scaled Projection Algorithm gradient-based beamforming implementations 
[Section 2.3.3]. 

6.4 Computational Complexity 

Figure 17 plots the number of real multiplications required per input snap shot, , 
jfO , by Complete Update Relaxation, Partial Update Relaxation, and Gradient LENS S 
Processing. 

Notably, the present invention separates the robustness constraining process 
from the beaniforming power minimization, in contrast to prior art techniques which 
combine the robustness constraint into the beamforming power minimization. One of 
ordinary skill will recognize that the signal processing technique of the present 
invention has a wide variety of system applications. 

Although the present invention has been shown and described with respect to 
several preferred embodiments thereof, various changes, omissions and additions to the 
form and detail thereof, may be made therein, without departing from the spirit and 
scope of the invention. 

What is claimed is: 
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